

Claims 

What is claimed is: 

^ 1. A method of programming an application ac^^sSible by a user through one or 

more computer-based devices, the method compjislrig the steps of: 

representing interactions that thc^^iier is permitted to have with the one or more 
computer-based devices used to apcJ^s the appUcation by interaction-based programming 
components; 

wherein the inferaction-based programming components are independent of 
content/appHcatipif logic and presentation requirements associated with the application, 
and further Wnerein the interaction-based programming components are transcoded on a 
compon^t by component basis to generate one or more modality-specific renderings of 
the/^plication on the one or more computer-based devices. 




• ^ 2. The method of claxpfl, in a client/server arrangement wherein at least a 

^ ponion of the application is^robe downloaded from a server to at least one of the one or 
more computer-based^evices, acting as a client, further comprising the step of including 
code in the applic^on operative to provide a connection to the content/application logic 
resident at the/server. 



expre 



3. The method oftflaim 2, wherein the content/application logic connection code 
expresses at leasjx<Jhe of one or more data models, atrribute constraints and validation 
rules associ^t^ with the application. 



\ 7 4. The method of claim 1, wherein the one or more modaUty-specific renderings 
/^omprise a speech-based P^resentation of portions of the application. 

5. The mej^od of claim 4, wherein the speech-based representation is based on 
VoiceXML. 
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6. The method of claim 1, wherein the one or more modahty-specific renderings 
comprise a visual-based representation of portions of the application. 

7. The method of claim 6, wherein the visual-based representation is based on at 
5 least one of HTML, CHTML and WML. 

8. The method of claim 1, wherein the/user interactions are declaratively 
represented by the interaction-based programming^omponents. 

10 9. The method of claim 1, wh^ein the user interactions are imperatively 

represented by the interaction-based pro^amming components. 



err 

fU 

! : = 
□ 



y 



15 



20 



10. The method of claim/1, wherein the user interactions are declaratively and 
imperatively represented by the/nteraction-based programming components. 

11. The method^ of claim 1, wherein the interaction-based programming 
components comprise b^^sic elements associated with a dialog that may occur between the 
user and the one or rnore computer-based devices. 

12. Th/S method of claim 11, wherein the interaction-based programming 
components comprise complex elements, the complex elements being aggregations of 
two or mor/ of the basic elements associated with the dialog that may occur between the 
user and me one or more computer-based devices. 



13. The method of claim 1, wherein one of the interaction-based programming 
components represent conversational gestures. 
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14. The method of claim 13, wherein the conversational gestures comprise a 
gesture for encapsulating informational messages to the user. / 

15. The method of claim 13, wherein the conversatioMl gestures comprise a 
gesture for encapsulating contextual help information. / 

16. The method of claim 13, wherein the cmversational gestures comprise a 
gesture for encapsulating actions to be taken upon successful completion of another 
gesture. / 

17. The method of claim 13, wherein the conversational gestures comprise a 
gesture for encapsulating yes or no based^uestions. 

18. The method of claim /f 3, wherein the conversational gestures comprise a 
gesture for encapsulating dialogues where the user is expected to select from a set of 
choices. / 

19. The method m claim 18, wherein the select gesture comprises a subelement 
that represents the set ai choices. 

20. The re^ethod of claim 18, wherein the select gesture comprises a subelement 
that represents /test that the selection should pass. 

21/ The method of claim 20, wherein the select gesture comprises a subelement 
that represents an error message to be presented if the test fails. 



/ 22. The method of claim 13, wherein the conversational gestures comprise a 
gesture for encapsulating rules for validating results of a given conversational gesture. 
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23. The method of claim 13, wherein the conversational gestures comprise a 
gesture for encapsulating grammar processing rules. X 

24. The method of claim 13, wherein/fhe conversational gestures comprise a 
gesture for encapsulating dialogues that hdp the user navigate through portions of the 
application. / 

25. The method of eland 13, wherein the conversational gestures comprise a 
gesture for encapsulating a request for at least one of user login and authentication 
information. / 

26. The metnod of claim 13, wherein the conversational gestures comprise a 
gesture for encapsulating a request for constrained user input. 

27. /The method of claim 13, wherein the conversational gestures comprise a 
gesture fior encapsulating a request for unconstrained user input. 

/ 28. The method of claim 13, wherein the conversational gestures comprise a 
gesture for controlling submission of information. 



The method of clainU^further comprising the step of providing a mechanism 
for defining logical input e)^s and the association between the logical input events and 
physical input events tl>^trigger the defined logical input events. 
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31. The method of claim 1, wherein the component ^y^component transcoding is 
performed in accordance with Java Bean. 

32. The method of claim 1, wherein tKe component by component transcoding is 
performed in accordance with Java ServerTages. 




33. The method of dmm 1, wherein representation by the interaction-based 
programming components OOTnits synchronization of the one or more modality-specific 
renderings of the application on the one or more computer-based devices. 

34. The method of claim 1, wherein representation by the the interaction-based 
programming components supports a natural language understanding envirormient. 

^^-^ 35. The methodof^cJ^ifTl^ comprising the step of including code for 

/permitting cosmetic^altSring of a presentational feature associated with the one or more 
modality-sp5^Hfic renderings of the application on the one or more computer-based 
devices^ 



36r^S3;e method of claim 1, further comprising the step of including code for 
permitting changes^^te^rules for transcoding on a component by component basis to 
generate the one or more m©45lity-specific renderings of the application on the one or 
more computer-based devices. 




37. The method of claim 1, wii&ein a definition of an underlying data model 
eir/g populated is separated fi-orna^arkup language defining the user interaction. 



38. The method/of claim 1, wherein a nodejd attribute is attached to each 
component and the attribute is mapped over to various outputs. 
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39. The method of claim 1, wherein an author is provided withX^pass through 
mechanism to encapsulate modality-specific markup components. / 

40. The method of claim 1, wherein the components m^ty be active in parallel. 

41. The method of claim 1, wherein the r^resentation and transcoding is 
extensible. / 

42. The method of claim 1, wherein aitate of the application is encapsulated. 

43. The method of claim 1, Wnerein the representation permits reference to 
dynamically generated data and supports callback mechanisms to the content/application 
logic. / 

44. Apparatus for use in accessing an application in association with one or more 
computer-based devices, the/pparatus comprising: 

one or more proce^ors operative to: (i) obtain the application fi^om an application 
server, the application being programmatically represented by interactions that the user is 
permitted to have with the one or more computer-based devices by interaction-based 
programming corafponents, wherein the interaction-based programming components are 
independent of/content/application logic and presentation requirements associated with 
the application; and (ii) transcode the interaction-based programming components on a 
component/oy component basis to generate one or more modality-specific renderings of 
the appliofation on the one or more computer-based devices. 

/ 45. The apparatus of claim 44, wherein the one or more processors are distributed 
ovp the one or more computer-based devices. 
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46. The apparatus of claim 44, in a client/server arjafigement wherein at least a 
portion of the application is to be downloaded from a server to at least one of the one or 
more computer-based devices, acting as a client, filrther comprising the step of including 
code in the application operative to provide ^^onnection to the content/application logic 
resident at the server. 



47. The apparatus opdaim 46, wherein the content/application logic connection 
cc^de expresses at le^st^ne of one or more data models, atrribute constraints and 
validation rules a^^ociated with the application. 

48. The apparatus of claim 44, wherein the on^r more modality-specific 
renderings comprise a speech-based representation of m>mons of the application. 

49. The apparatus of claim 48, wherein the speech-based representation is based 
on VoiceXML. 

50. The apparatus of cPmm 44, wherein the one or more modality-specific 
renderings comprise a visual-)?ased representation of portions of the application. 

51. The appajmus of claim 50, wherein the visual-based representation is based 
on at least one of HTML, CHTML and WML. 

52. yrhe apparatus of claim 44, wherein the user interactions are declaratively 
represent^ by the interaction-based programming components. 



53. The apparatus of claim 44, wherein the user interactions are imperatively 
represented by the interaction-based programming components. 
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54. The apparatus of claim 44, wherein the user interactions are declaratively and 
imperatively represented by the interaction-based programming components. 

55. The apparatus of claim 44, wherein the interaction-based programming 
components comprise basic elements associated with a dialog^mat may occur between the 
user and the one or more computer-based devices. / 

56. The apparatus of claim 55, wherein ytne interaction-based programming 
components comprise complex elements, the complex elements being aggregations of 
two or more of the basic elements associated With the dialog that may occur between the 
user and the one or more computer-based devices. 

57. The apparatus of claim 44/ wherein one of the interaction-based programming 
components represent conversational gestures. 

58. The apparatus of/claim 57, wherein the conversational gestures comprise a 
gesture for encapsulating informational messages to the user. 

59. The appamus of claim 57, wherein the conversational gestures comprise a 
gesture for encapsulafting contextual help information. 

60. Ther apparatus of claim 57, wherein the conversational gestures comprise a 
gesture for encapsulating actions to be taken upon successful completion of another 
gesture. / 

/61. The apparatus of claim 57, wherein the conversational gestures comprise a 
gesture for encapsulating yes or no based questions. 

Y0999-478 128 



# 



62. The apparatus of claim 57, wherein the conversational gestures cormmse a 
gesture for encapsulating dialogues where the user is expected to select frogr a set of 
choices. 

63. The apparatus of claim 62, wherein the select gesture cginprises a subelement 
that represents the set of choices. 

64. The apparatus of claim 62, wherein the select/gesture comprises a subelement 
that represents a test that the selection should pass. 

65. The apparatus of claim 64, wherein rfie select gesture comprises a subelement 
that represents an error message to be presented if the test fails. 

66. The apparatus of claim 57^ wherein the conversational gestures comprise a 
gesture for encapsulating rules for Wlidating results of a given conversational gesture. 

67. The apparatus o£/claim 57, wherein the conversational gestures comprise a 
gesture for encapsulating grammar processing rules. 

68. The apn^atus of claim 57, wherein the conversational gestures comprise a 
gesture for encap^lating dialogues that help the user navigate through portions of the 
application. 



). The apparatus of claim 57, wherein the conversational gestures comprise a 
gesti^ for encapsulating a request for at least one of user login and authentication 
information. 
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70. The apparatus of claim 57, wherein the convers^timial gestures comprise a 
gesture for encapsulating a request for constrained user hajJut. 

71. The apparatus of claim 57, wh^:^n the conversational gestures comprise a 
gesture for encapsulating a request fonuliconstrained user input. 

72. The apparatus^of^ :laim 57, wherein the conversational gestures comprise a 
gesture for controlUng^^bmission of information. 



' 73. The ap 



atus 




of claim 44, further comprising the step of providing a 
mechanism for^^erfining logical input events and the association between the logical input 
events and eiiysical input events that trigger the defined logical jnput events. 

74. The apparatus of claim 44, wherein the comppilent by component transcoding 
is performed in accordance with XSL transformationjKfles. 

75. The apparatus of claim 44, wherein the component by component transcoding 
is performed in accordance with Java Bcdx/^ 

76. The apparatus of claim44, wherein the component by component transcoding 
is performed in accordance wirtr Java Server Pages. 

77. The apparatus of claim 44, wherein representation by the interaction-based 
programming comnements permits synchronization of the one or more modality-specific 
renderings of th^pplication on the one or more computer-based devices. 
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78. The apparatus of claim 44, whereijix^presentation by the the 
interaction-based programming components sugpeffs a natural language understanding 



environment. 



79. The apparatus of claim 44, flirtlji^r^mprising the step of including code for 
ermitting cosmetic altering of a pres^ational feature associated with the one or more 
modality-specific renderings the apphcation on the one or more computer-based 
devices. 



80. TJ;ie apparatus of claim 44, further comprising the step of including code for 
permitting/changes to rules for transcoding on a component by component basis to 
generate the one or more modality-specific renderings of the application on the one or 
moi^ computer-based devices. 
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81. The apparatus of claim 44, wherein a defmition4)f an underlying data model 



\Q being populated is separated fi-om a markup language dining the user interaction. 



82. The apparatus of claim 44, wherebr a node_id attribute is attached to each 
component and the attribute is mapped ovento various outputs. 

83. The apparatus of claim 44, wherein an author is provided with a pass through 
mechanism to encapsulate modality-specific markup components. 



84. The apparatus of claim 44, wherein the components may be active in parallel. 



85. The apnm-atus of claim 44, wherein the representation and transcoding is 
extensible. / 



86. The apparatus of claim 44, wherein a state of the application is encapsulated. 

87. The apparatus of claim 44, wherein the representation penmts reference to 
dynamically generated data and supports callback mechanisms to th^ontent/application 
logic. 
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88. The apparatus of claim 44, wherein the one or rnore processors are distributed 
over the one or more computer-based devices and the application is synchronized across 
the one or more computer-based devices. 

89. The apparatus of claim 44, wherd^ the representation of the apphcation 
further permits cosmetization of the one or i^re modality-specific renderings via one or 
more modality-specific markup languages. 

90. A browser apparatus for/se in providing access to an apphcation by a user 
through one or more computer-ba/ed devices, comprising a machine readable medium 
containing computer executabl9/code which when executed permits the implementation 
of the steps of: 

obtaining the application from an application server, the application being 
programmatically represented by interactions that the user is permitted to have with the 
one or more computer-based devices by interaction-based programming components, 
wherein the int^action-based programming components are independent of 
content/applicati)m logic and presentation requirements associated with the application; 
and 

transcoding the interaction-based programming components on a component by 
componem basis to generate one or more modality-specific renderings of the application 
on the cme or more computer-based devices. 
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91. An article of manufacture for use in programmineaif^plication accessible 

L /by a user through one or more computer-based devices,x<r6rnprising a machine readable 

/ ^ 
medium containing computer executable codp'^hich when executed permits the 

implementation of the steps of: y< 

representing interactions thaMlie user is permitted to have with the one or more 

computer-based devices used to^ccess the application by interaction-based programming 

components; 

wherein the^/interaction-based programming components are independent of 
content/applicatiiem logic and presentation requirements associated with the application, 
and further wherein the interaction-based programming components are transcoded on a 
componem by component basis to generate one or more modality-specific renderings of 
the application on the one or more computer-based devices. 
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